Method for automatically focusing on specific movable object, photographic apparatus including automatic focus function, and computer readable storage medium for storing automatic focus function program

ABSTRACT

A method capable of performing an automatic focus function upon a specific movable object in a real-time manner, the method being applicable to a photographic apparatus with the automatic focus function, includes: capturing real-time image within a field of view (FOV) of a lens; comparing images of a plurality of image areas of the real-time image with a feature image of the specific movable object to identify an image area corresponding to the feature image of the specific movable object; and, performing automatic focus on the identified image area.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The disclosed embodiments of the present invention relate to aphotographic mechanism, and more particularly, to a method forautomatically focusing on a specific movable object, relatedphotographic apparatus, and related computer readable storage medium.

2. Description of the Prior Art

The existing photographic technology is capable of performing the facedetection or the smile detection upon people within the field of view ofthe lens. The existing technology, however, is only able to detect allthe characters, and can not distinguish between the desiredphotographing target which is usually the main character and thebackground characters. In static photographing, users have plenty oftime to fix the deviated focus manually to refocus on the desired targetcharacters; however, in dynamic photographing, users do not have time tofix the deviated focus manually. Therefore, even if the existingphotographic technique is able to detect all the faces in a filed ofview, there is a great possibility that the actual focus is on thebackground characters instead of the desired main character, resultingin the captured picture that is out of focus and is unwanted to theusers.

SUMMARY OF THE INVENTION

Therefore, one of the objectives of the present invention is to providea method for automatically focusing on a specific movable object,related photographic apparatus, and related computer readable storagemedium, to solve the above-mentioned issues.

According to a first aspect of the present invention, an exemplarymethod capable of performing automatic focus function upon a specificmovable object in real time is disclosed. The exemplary method includes:capturing a real-time image within a field of view (FOV) of a lens;comparing images of a plurality of image areas of the real-time imagewith a feature image of the specific movable object to identify an imagearea corresponding to the feature image of the specific movable object;and performing automatic focus upon the identified image area.

According to a second aspect of the present invention, an exemplaryphotographic apparatus with the automatic focus function is disclosed.The exemplary photographic apparatus includes a lens and a processingcircuit. The lens is arranged for capturing a real-time image within afield of view (FOV) of the lens. The processing circuit is electricallycoupled to the lens, arranged for comparing images of a plurality ofimage areas of the real-time image with a feature image of the specificmovable object to identify an image area corresponding to the featureimage of the specific movable object, wherein the lens performingautomatic focus upon the identified image area.

According to a third aspect of the present invention, an exemplarynon-transitory computer-readable medium is disclosed. The exemplarynon-transitory computer-readable medium coupled to an electronicapparatus has a circuit system, wherein the computer-readable medium,which is capable of performing automatic focus function upon a specificmovable object in real time, includes at least a program code storedtherein, and following steps are performed when the program code is readand executed: capturing a real-time image within a field of view (FOV)of a lens; comparing images of a plurality of image areas of thereal-time image with a feature image of the specific movable object toidentify an image area corresponding to the feature image of thespecific movable object; and performing automatic focus upon theidentified image area.

These and other objectives of the present invention will no doubt becomeobvious to those of ordinary skill in the art after reading thefollowing detailed description of the preferred embodiment that isillustrated in the various figures and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a photographic apparatus with anautomatic focus function according to a preferred embodiment of thepresent invention.

FIG. 2A is a diagram illustrating multiple real-time images capturedwithin the field of view of the lens at different time points.

FIG. 2B is another diagram illustrating multiple real-time imagescaptured within the field of view of the lens at different time points.

FIG. 3 is a block diagram illustrating a photographic apparatus with anautomatic focus function according to another embodiment of the presentinvention.

DETAILED DESCRIPTION

Certain terms are used throughout the description and following claimsto refer to particular components. As one skilled in the art willappreciate, manufacturers may refer to a component by different names.This document does not intend to distinguish between components thatdiffer in name but not function. In the following description and in theclaims, the terms “include” and “comprise” are used in an open-endedfashion, and thus should be interpreted to mean “include, but notlimited to . . . ”. Also, the term “couple” is intended to mean eitheran indirect or direct electrical connection. Accordingly, if one deviceis electrically connected to another device, that connection may bethrough a direct electrical connection, or through an indirectelectrical connection via other devices and connections.

Please refer to FIG. 1, which is a block diagram illustrating aphotographic apparatus 100 with an automatic focus function according toa preferred embodiment of the present invention. The photographicapparatus 100 includes a lens 105, a storage circuit 110, and aprocessing circuit 115. The lens 105 is used to capture a real-timeimage IMG_RT within the field of view range of the lens 105. Inaddition, before capturing the real-time image IMG_RT, the lens 105captures at least one reference image IMG_P of a specific movable object(i.e., a target photographic object) in advance, and then outputs thereal-time image IMG_RT 105 captured by the lens 105 as well as thepre-captured reference image IMG_P to the processing circuit 115. Theprocessing circuit 115 is coupled to the lens 105, and used forprocessing the reference image IMG_P captured in advance to generate thefeature image IMG_F of the specific movable object, and storing thefeature image IMG_F in the storage circuit 110, where the storagecircuit 110 is used to record the feature image IMG_F of the specificmovable object into a database. After lens 105 captures the real-timeimage IMG_RT, the processing circuit 115 can compare images of aplurality of image areas of the real-time image IMG_RT with the featureimage IMG_F of the specific movable object one by one according to thereal-time image IMG_RT captured by the lens and the feature image IMG_Frecorded in the database, thereby identifying the image areacorresponding to the feature image IMG_F of the specific movable objectfrom the plurality of image areas. After the image area is identified,the processing circuit 115 controls the lens 105 to focus on theidentified image area, and therefore achieves the automatic focusfunction.

In this embodiment, the specific movable object may be a specificmovable target object. For example, the target object may be a specifictarget person or target animal. When the lens 105 captures the real-timeimage IMG_RT for each time point according to a capture rate, if thetarget person or target animal moves, then the position where the targetperson or target animal is located within the field of view of the lens105 may vary with time. For example, please refer to FIG. 2A and FIG.2B. FIG. 2A and FIG. 2B are diagrams illustrating multiple real-timeimages IMG_RT captured within the field of view 210 of the lens 105 atdifferent time points t0 and t1. As shown in FIG. 2A, reference numerals205A-205C indicate images and locations of different characters whichare arranged in the order of positions, wherein the reference numeral205A represents an image of a target character, and the target character205A has a behavior of moving along with the time. As a result, thetarget character and a character 205B interchange positions with eachother. As shown in FIG. 2B, the target character 205A is now locatedbetween the character 205B and the character 205C. The photographicapparatus 100 in the present embodiment is capable of continuouslyfocusing on the target character 205A automatically. At the time pointt0, the photographic apparatus 100 is capable of focusing on the frontposition shown in FIG. 2A where the target character 205A is located,while at the time point t1, the photographic apparatus 100 is capable offocusing on the middle position shown in FIG. 2B where the targetcharacter 205A is located. No matter how the target character moves, thephotographic apparatus 100 is able to identify the image position of thetarget character as long as the target character is still within thefield of view of the lens 105. Also, the lens 105 would focus on theposition of the image so that the user does not have to worry that theimage may be out of focus, but simply presses a button (e.g., a physicalbutton or a virtual button) at any moment he/she wants to photograph toobtain a high-quality image with accurate focus and without distortion.In addition, the automatic focus function mentioned above is alsosuitable for filming. When the user utilizes the photographic apparatus100 to photograph the target character 205A, after the user presses thephotographing button, the photographic apparatus 100 would identify thelocation of the target character and then the lens 105 would focus onit. Hence, the user does not need to be concerned about the out-of-focusissues while using the photographic apparatus 100.

The real-time image identification and automatic focus operation of thephotographic apparatus 100 are described as follows. The lens 105extracts the real-time image IMG_RT based on an appropriate frequency,wherein the content of a real-time image IMG_RT is like the image of thefield of view shown in FIG. 2A or FIG. 2B. The captured real-time imageIMG_RT is sent to the processing circuit 115, and the processing circuit115 identifies the specific target character from the plurality of imageobjects within the real-time image IMG_RT. First of all, the processingcircuit 115 analyzes the image objects within the real-time image IMG_RTto obtain the possible image position of the target character.Practically, the processing circuit 115 may use a face detectionoperation to obtain multiple image-area positions corresponding tomultiple characters (which is regarded as multiple movable objects)respectively, followed by identifying the correct image position of thetarget character from the image-area positions. After the image-areaposition or area of the specific target character is identified, theprocessing circuit 115 may control the lens 105 to focus on theimage-area of the identified target character to achieve the automaticfocus function. For instance, as shown in FIG. 2A, by means of the facedetection operation, the processing circuit 115 may obtain the analysisresult showing that the real-time image includes the image-areapositions of the plurality of characters 205A-205C, and then comparesthe images located in the above-mentioned image-area positions with thefeature image IMG_F of the target character, respectively, to therebyidentify that the correct image position of the target character is theimage position of the image 205A. Therefore, the processing circuit 115can control the lens 105 to focus on the identified target characterimage 205A, to achieve the effect of automatic focus. It should be notedthat, the aforementioned specific movable object is not limited to thetarget character. In other embodiments, it may be a target animal, amoving target object (e.g., a vehicle such as a car) and so on. In otherwords, the automatic focus function of the photographic apparatus 100 ofthe present invention is applicable to photographing target characters,target animals, or moving target objects. Besides, face detection isutilized to analyze the possible image-area position of the charactersin the real-time image IMG_RT in aforementioned embodiment. However,this is not a limitation of the present invention. In practice, otherdetection operations may be utilized in the analysis of the possibleimage-area position of the real-time image.

In addition, please note that the real-time image IMG_RT obtained by thelens 105 refers to the real-time image imaged on the capacitive couplingelement array within the field of view of the lens 105 throughreflection of light while the user operates the photographic apparatus100. In other words, the real-time image IMG_RT obtained by the lens 105refers to the image imaged on the photosensitive elements of thephotographic apparatus 100 in a real time manner before the user pressesthe photographing button, and the real-time image IMG_RT would presentdifferent imaging results in response to the objects varying or movingwithin the field of view of the lens 105. That is, the real-time imageIMG_RT refers to the image captured by the lens 105 instantly while theuser is photographing formally. In addition, the pre-stored referenceimage IMG_P refers to the reference image obtained by capturing aspecific character or a specific animal before the user photographsformally. The reference image IMG_P includes the feature of the specifictarget character or the specific animal, and is utilized to generate thefeature image IMG_F of the specific moving object, where the feature(can be regarded as the feature image) would be referenced by theprocessing circuit 115 to perform automatic focus upon part of thereal-time image IMG_RT.

In a practical operation, the photographic apparatus 100 allows the userto pre-photograph first before the formal photographing, thus creatingan image database of the specific moving object. Next, the followingsteps would check whether the real-time image IMG_RT is the same as thefeature image IMG_F resulting from the reference image of the imagedatabase, and identify whether the specific moving object exists on thephotosensitive screen as well as the corresponding position. After theidentification is done, the automatic focus operation is performed suchthat the focus would be directed to the image position of the specificmovable object to achieve the automatic tracking and focusing effect.Regarding the pre-photographing process, the processing circuit 115controls the lens 105 to pre-shoot at least one reference image IMG_P ofthe specific movable object. After that, the processing circuit 115generates the feature images IMG_F according to the at least onereference image IMG_P, and records the feature image IMG_F of thespecific movable object into the database through the storage circuit110. It should be noted that, if there is only one pre-photographingreference image, the process of generating the feature image maydirectly utilize the image corresponding to the specific movable objectof the reference image IMG_P (i.e., part of the image of the referenceimage) as the feature image IMG_F of the specific movable object.Conversely, if there is more than one pre-photographing reference imageIMG_P, the process of generating the feature image IMG_F may utilize animage corresponding to the specific movable object within an averageimage derived from averaging the reference images IMG_P (i.e., part ofthe average image) as the feature image IMG_F of the specific movableobject. Besides, any other processes of generating the feature imageaccording to the reference image all obey the spirit of the presentinvention, and also belong to the scope of the present invention.

Besides, in a practical design where a target character is shot toobtain the feature image IMG_F, the pre-photographed feature image IMG_Fmay be physiological characteristics such as the target character's faceor appearance, the shape of the facial features, skin color, hair, etc.Besides, in other embodiments, the feature image may be thecharacteristics of the target character's dressing, characteristics ofthe target character's accessories, or characteristics of the targetcharacter's belongings. For example, the color and style of the coat,the type and style of jewelry, portable packages, rain gears, and so on.By pre-photographing the feature image IMG_F of the target character,the processing circuit 115 can identify the accurate image position ofthe target character in a real time manner from a real-time imageIMG_RT, which includes a number of characters. Therefore, this makes thephotographic apparatus 100 applicable to capturing a specific targetcharacter or some specific target characters among a group of movingcharacters.

Furthermore, in other embodiments, the operations performed by theaforementioned processing circuit 115 may be realized by a computerprogram code. Please refer to FIG. 3, which is a block diagramillustrating a photographic apparatus 300 with an automatic focusfunction according to another embodiment of the present invention. Thephotographic apparatus 300 includes a lens 305, a storage circuit 310,and a processor 315, wherein the storage circuit 310 is acomputer-readable storage medium implemented by a memory element andhaving a computer program COMP stored therein. The processor 315 readsand executes the computer program stored in the storage circuit 310 toperform the step of automatically focusing on a specific movable objectin a real-time manner. The steps include capturing the real-time imageIMG_RT, comparing the real-time image IMG_RT with the feature imageIMG_F to identify the specific movable target object, and performingautomatic focus upon the identified image area to achieve the automatictracking and focusing effect. As the aforementioned steps are similar tothe operation steps of the photographic apparatus 100 shown in FIG. 1,the description is omitted here for brevity. Moreover, in otherembodiments, the computer program COMP may be stored in an externalmemory element. When the photographic apparatus 300 boots up, theprocessor 315 reads the computer program COMP and stores it into thestorage circuit 310 for subsequent use.

Based on the above descriptions, when a user uses the photographicapparatus 100/300 of the embodiment of the present invention, the targetfeature image IMG_F can be obtained by means of pre-photographing beforethe formal photographing is initiated, so the target identification canbe done during the formal photographing. In this way, the photographicapparatus 100/300 can identify the specific target within the field ofview of the lens 105/305, and then automatically focus on the target.Therefore, the user simply needs to press the photographing button toobtain properly focused images. In addition, while a target character isbeing photographed, the aforementioned target identification andautomatic focusing function of the present invention may be combinedwith the function and operation of smile detection photographing. Hence,the focus is on the target character by using the aforementioned targetidentification and automatic focus function, and then an image iscaptured according to the smile detection photographing. In this way,the user can get the high-quality image of the target characters withoutpressing the photographing button. Furthermore, in the above-describedembodiments, the photographic apparatus 100/300 may be disposed in acamera apparatus, a mobile communication device, or any handheldportable apparatus. These all belong to the scope of the presentinvention.

Those skilled in the art will readily observe that numerousmodifications and alterations of the device and method may be made whileretaining the teachings of the invention. Accordingly, the abovedisclosure should be construed as limited only by the metes and boundsof the appended claims.

What is claimed is:
 1. A method of performing an automatic focusfunction upon a single specific movable target object in a real-timemanner, the method being applicable to a photographic apparatus, whichcomprises a photographing button and a lens and has the automatic focusfunction, the method comprising: photographing a reference image, beforethe photographing button is pressed, of the single specific movabletarget object through the lens to generate a feature image of the singlespecific movable target object; storing the feature image of the singlespecific movable target object in a database; capturing a real-timeimage within a field of view (FOV) of the lens; comparing images of aplurality of image areas of the real-time image with the feature imageof the single specific movable target object for identifying an imagearea corresponding to the feature image of the single specific movabletarget object and identifying, after the photographing button ispressed, a location of the single specific movable target object,wherein the feature image of the single specific movable target objectis identified within the real-time image and corresponds to at least aportion of a dressing characteristic of a person, an accessorycharacteristic of a person, a non-physiological possessioncharacteristic of a person, or an animal characteristic withoutincluding human characteristic; and performing automatic focus of thelens, after the photographing button is pressed, upon the identifiedlocation of the single specific movable target object.
 2. The method ofclaim 1, wherein the images of the plurality of image areas compriseimages corresponding to a plurality of movable objects, and saididentifying the image area corresponding to the feature image of thesingle specific movable target object comprises: identifying the featureimage of the single specific movable target object from the imagescorresponding to the plurality of movable objects.
 3. A photographicapparatus with an automatic focus function, comprising: a photographingbutton; a storage circuit configured to store images; a lens configuredto capture a real-time image within a field of view (FOV) of the lens;and a processing circuit electrically coupled to the lens, andconfigured to compare images of a plurality of image areas of thereal-time image with a feature image of a single specific movable targetobject to identify an image area corresponding to the feature image ofthe single specific movable target object and identify, after thephotographing button is pressed, a location of the single specificmovable target object, wherein the feature image of the single specificmovable target object is identified within the real-time image andcorresponds to at least a portion of a dressing characteristic of aperson, an accessory characteristic of a person, a non-physiologicalpossession characteristic of a person, or an animal characteristicwithout including human characteristic; wherein the lens is configuredto capture a reference image, before the photographing button ispressed, of the single specific movable target object, and theprocessing circuit is configured to generate the feature image of thesingle specific movable target object to be stored in a database in thestorage circuit, and a focus of the lens is focused on, after thephotographing button is pressed, the identified location of the singlespecific movable target object through performing automatic focus. 4.The photographic apparatus of claim 3, being disposed on a mobilecommunication apparatus or a camera apparatus.
 5. The photographicapparatus of claim 3, wherein the images of the plurality of image areascomprises images corresponding to a plurality of movable objects, andthe processing circuit is configured to identify the feature image ofthe single specific movable target object from the images correspondingto the plurality of movable objects.
 6. A non-transitorycomputer-readable medium, storing a computer program for performing anautomatic focus function upon a single specific movable target object ina real-time manner, the computer program, when executed by aphotographic apparatus, which comprises a photographing button and alens and has the automatic focus function, causing the photographicapparatus to execute: photographing a reference image, before thephotographing button is pressed, of the single specific movable targetobject through the lens to generate a feature image of the singlespecific movable target object; storing the feature image of the singlespecific movable target object in a database; capturing a real-timeimage within a field of view (FOV) of the lens; comparing images of aplurality of image areas of the real-time image with the feature imageof the single specific movable target object for identifying an imagearea corresponding to the feature image of the single specific movabletarget object and identifying, after the photographing button ispressed, a location of the single specific movable target object,wherein the feature image of the single specific movable target objectis identified within the real-time image and corresponds to at least aportion of a dressing characteristic of a person, an accessorycharacteristic of a person, a non-physiological possessioncharacteristic of a person, or an animal characteristic withoutincluding human characteristic; and performing automatic focus of thelens, after the photographing button is pressed, upon the identifiedlocation of the single specific movable target object.
 7. Thecomputer-readable medium of claim 6, wherein the images of the pluralityof image areas comprises images corresponding to a plurality of movableobjects, and said identifying the image area corresponding to thefeature image of the single specific movable target object comprises:identifying the feature image of the single specific movable targetobject from the images corresponding to the plurality of movableobjects.